Feedback control method for operating a device with a visual display

ABSTRACT

There is provided a feedback and control method of operating a device. The method seeks to minimise cognitive load on a user, including novice users, and seeks to enable efficient, competent control of a device, and informed selection of and between optimum configurations. The method comprises determining values that are representative of each of a plurality of variables, representing each of the variables on a display using a display component, wherein a dimension of each display component is proportional to the value that is representative of the corresponding variable, and wherein the display components representing each of the variables are arranged substantially contiguously such that when the sum of the values is equal to a pre-defined constant (X) the substantially contiguously arranged display components extend between an origin point on the display and a target end point on the display, receiving an input that changes one of the values and consequentially adjusting the corresponding display component.

TECHNICAL FIELD

The present invention relates to methods of operating devices providinga feedback and control method, seeking to mitigate cognitive load on auser, including novice users, and seeking to enable efficient, competentcontrol of a device, and informed selection of and between optimumconfigurations. In particular the present invention can be applied toimage capture devices, but other devices are able to utilise a feedbackand control input provided.

BACKGROUND

Devices are typically provided with user controls and display screens.Sometimes the controls are physical controls in the form of for exampleknobs, buttons and dials. Sometimes the controls are virtual, forexample displayed on a touchscreen. It is also possible to provide a mixof virtual and physical controls. Display screens can be provided tosimply display information or to receive inputs as well as displayinformation (e.g. using a touchscreen). Typically feedback on thecontrols selected by a user is provided by physical indications inrespect of physical controls (for example using markings such as spacedlines, or numbers, or icons) and on a display (for example bydynamically varying graphics on a screen or by a simple display ofnumbers, characters or icons).

A good example of a device providing such user controls and displayscreens is an image capture device, for example such as a still-imagecamera or video camera.

An image capture device is device for capturing images that may bestored locally, transmitted to another location, or both. The images maybe individual still photographs or sequences of images constitutingvideos or movies.

The term “image capture device”, as used herein, therefore refers to anydevice that can be used to capture an image of a scene (i.e. that iswithin a field of view of the image capture device) and the term is usedherein to include photographic still cameras that use either film orelectronic image sensors, digital cameras, video or movie cameras,camcorders, telescopes, microscopes, endoscopes, virtual cameras (usedwithin virtual environments), computing devices with built-in cameras(including smartphones, smart watches, smart glasses, tablets, laptops,desktops), imaging devices using computational imaging techniques tocombine the output of multiple cameras into a single image or sequenceof images constituting videos or movies, etc.

FIG. 1 illustrates schematically a conventional image capture device 10comprising an enclosure 11, a lens 12, an optical diaphragm 13 definingan aperture 14, a shutter 15 and an image sensor 16. The lens 12 focusesthe light reflected or emitted from objects that make up a scene that iswithin a field of view of the image capture device onto the image sensor16. The shutter 15 controls the length of time that light can enter theimage capture device 10. The size of the aperture 14 defined by theoptical diaphragm 13 regulates the amount of light that passes throughthe lens 12 and controls the depth of field, which is the distancebetween the nearest and farthest objects in a scene that appear to be infocus. Reducing the size of the aperture 14 increases the depth offield, and conversely increasing the size of the aperture 14 decreasesthe depth of field. Depending upon the type of image capture device, theimage sensor 16 will be either a light-sensitive material (e.g.photographic film) or an electronic image sensor (e.g. a charge-coupleddevice (CCD) image sensor or an active-pixel sensor (APS)/CMOS imagesensor).

The variable attributes of an image capture device that impact on theimage captured therefore comprise the size of the aperture, the shutterspeed/exposure time, and the sensitivity the image sensor. Whilst somesimple forms of image capture devices, such as disposable cameras,provide little to no control over these attributes, more sophisticatedimage capture devices, such as digital single-lens reflex (DSLR)cameras, provide means for the user to control each of these attributes.However, in such devices each of these attributes is controlledindependently of the others, with the only feedback being provided bythe independent display of representative values for each of thesevariables. Even when these devices provide a semi-automated mode, inwhich a change in one of these variable attributes by the user resultsin an automatic, consequential change in one of the other attributes,the image capture device provides no direct, intuitive feedback as tothe effect that this consequential change will have on the image to becaptured.

By way of example, conventional digital SLR and mirrorless camerastypically allow the user to choose between manual, semi-automatic andautomatic exposure modes. In manual mode all of the cameras exposuresettings are controlled independently of one another by the user, whilstin automatic mode all of the cameras exposure settings are controlled bythe camera's internal processing. The semi-automatic mode then typicallyhas various sub-modes, including:

-   -   Aperture Priority mode—in which the user sets the aperture and        ISO values and the cameras internal processing sets the shutter        speed so as to achieve a ‘correct exposure’;    -   Shutter Priority mode—in which the user sets the shutter speed        and ISO values and the cameras internal processing sets aperture        so as to achieve a ‘correct exposure’; and    -   Program mode—in which the user sets ISO value and one of the        aperture and shutter speed, and the cameras internal processing        then sets the other of the aperture or shutter speed to        compensate and achieve a ‘correct exposure’.

Consequently, when a user wishes to operate in semi-automatic mode theymust take a minimum of two exposure setting operations before theshutter can be pressed. Specifically, the user must change the camerainto the desired semi-automatic mode, and then set the one or both ofthe variables that will not be automatically set by the cameras internalprocessing.

In addition, the representative values used for these variableattributes have no immediately apparent correlation with their effect onthe captured image, and it therefore requires the user to havesignificant knowledge and/or prior experience in order for them to knowwhether the particular combination of values selected is likely tocapture a suitable image.

Specifically, on conventional image capture devices that provide usercontrol of these attributes, the aperture size is represented using anf-number, or relative aperture, which is the ratio of the lens's focallength (f) to the diameter of the aperture (D). Consequently, anincrease in the aperture diameter that leads to an increase in theamount of light reaching the image sensor, and therefore a consequentialincrease in the luminance of the captured image, involves decreasing thef-number displayed on the image capture device. The aperture controls onconventional image capture devices are also configured to adjust theaperture diameter in discrete steps, known as stops, where each stopincreases or decreases the f-number by a factor of approximately √2. Forexample, a standard scale provides values of f/1, f/1.4, f/2, f/2.8,f/4, f/5.6, f/8, f/11, f/16, f/22, f/32, f/45, f/64, f/90, f/128, etc.

The shutter speed, or exposure time, is the length of time that theimage sensor is exposed to light during image capture and is representedby the value in seconds. The amount of light that reaches the imagesensor is proportional to the exposure time. Consequently, an increasein the exposure time that would lead to an increase in the amount oflight reaching the image sensor, and therefore a consequential increasein the luminance of the captured image, involves increasing the exposuretime displayed on the image capture device. The shutter speed controlson conventional image capture devices are also configured to adjust theshutter speed in discrete steps, with a standard image capture deviceproviding a shutter speed scale of 1/1000, 1/500, 1/250, 1/125, 1/60,1/30, 1/15, ⅛, ¼ etc.

The sensitivity of the image sensor is conventionally represented usinga numerical scale defined by the International Organization forStandardization (ISO) (e.g. ISO 5800:2001 for colour negative film andISO 12232:2006 for digital still-cameras). For example, a typical imagecapture device will provide an ISO sensitivity scale of 100, 200, 400,800, and 1600 as a minimum. The higher the number, the more sensitivethe image sensor is to light. Consequently, an increase in thesensitivity, which would lead to a consequential increase in theluminance of the captured image, involves increasing the ISO sensitivityvalue displayed on the image capture device. These values are alsorelative to one another, so ISO 200 is twice as sensitive as ISO 100,and ISO 800 is four times as sensitive as ISO 200, and so on.

Furthermore, the variables that impact on the image captured by an imagecapture device comprise these attributes of the image capture device butalso other external factors/conditions that affect the amount/intensityof the light that reaches the image sensor (i.e. the image planeilluminance). In particular, the image to be captured is affected byexternal factors/conditions such as the scene luminance (L_(v)) (i.e.the intensity of the light reflected or emitted by the scene), which isnot directly and intuitively displayed on conventional image capturedevices. Indeed, consideration for the affect of scene luminance isusually incorporated into the photography process by the use of a lightmeter (either internal or external). Light meters determine a measure ofthe scene luminance and use this as an input into an exposure equationto provide the user with recommended values for the aperture size, theshutter speed, and the sensitivity of the image capture device.

Consequently, there are various problems that arise from the way inwhich conventional image capture devices represent, provide feedback on,and provide control of the variables that impact on an image to becaptured. In particular, these factors make the control of an imagecapture device by the user complex and unintuitive, and provide userswith limited effective control of the image capture process as they relyheavily on the user having significant understanding and experience tobe able to select image variables that both produce a ‘correct exposure’and achieve the user's preferred trade-off between grain blur (whichpositively correlates with the sensitivity of the image sensor), motionblur (which positively correlates with the exposure time), and depth offield/background blur (which positively correlates with the aperturesize), these being the consequential secondary effects of the exposurevariables.

SUMMARY

Accordingly, various aspects and/or embodiments provide methods ofoperating devices such as an image capture device and devices, includingimage capture devices, that provide for an improved image captureprocess by seeking to minimise the risk that the captured image willhave an undesirable exposure/image luminance whilst allowing the usersubstantially full and intuitive control of the image capture deviceattributes. The methods described herein provide the user of an imagecapture device with intuitive control of and feedback on each individualimage variable and their combined impact on the image to be captured.These methods also devices such as enable image capture devices to makeuse of simplified user controls and simplified displays, as well assimplifying the use of peripheral controls and/or display for devicessuch as image capture devices.

Therefore, according to a first aspect there is provided a feedback andcontrol method of operating a device, the method comprising:

-   -   determining values that are representative of each of a        plurality of variables;    -   representing each of the variables on a display using a display        component, wherein a dimension of each display component is        proportional to the value that is representative of the        corresponding variable, and wherein the display components        representing each of the variables are arranged substantially        contiguously such that when the sum of the values is equal to a        pre-defined constant (X) the substantially contiguously arranged        display components extend between an origin point on the display        and a target end point on the display; and    -   receiving an input that changes one of the values that is        representative of one of the variables and consequentially        adjusting the corresponding display component.

Optionally, the device is an image capture device operable to capture animage of a scene. Such devices are typically supplied with a range ofconfigurable options, which can be advantageous to control using themethod.

Optionally, one or more of the plurality of variables comprise imagevariables. If an image capture device is being used, then the control ofimage variables is likely to be a useful feature.

Optionally, the method as disclosed herein further comprises thecapturing of an image using the image variables as changed by thereceiving of the input. The image variables, and hence the controloptions associated therewith, may be liable to vary according to thesubject of the image being captured.

Optionally, in order to provide that the captured image has a targetimage luminance/brightness (chosen as desirable), the pre-definedconstant (X) must be given an appropriate value.

Optionally, the target end point is indicated on the display, and morepreferably wherein the target end point is indicated on the display by afurther display component.

Optionally, when the sum of the representative values is greater thanthe pre-defined constant (X) the substantially contiguously arrangeddisplay components extend beyond the target end point, and optionallywhen the sum of the representative values is less than the pre-definedconstant (X) the substantially contiguously arranged display componentsdo not reach the target end point. Optionally, such contiguous displaymay be represented in what is conventionally referred to as a “doughnutchart”.

Optionally, the display components may comprise correspondingly shapedelements shown by the display. Each display component optionallycomprises a shape shown on the display for which the dimension that isproportional to the value that is representative of the correspondingimage variable extends between a first end to a second end of thedisplay component, and wherein the display components are arranged suchthat the first end of a display element corresponding to one of theimage variables is adjacent to the second end of an immediatelypreceding display component.

Optionally, each of display components comprises a circular arc shown onthe display, and wherein the length of the arc is proportional to thevalue that is representative of each image variable. Then when the sumof the representative values is equal to a pre-defined constant (X) thesubstantially contiguously arranged display components may extend arounda circumference of a circle.

Alternatively, each of display components may comprise any of: a lineand parallelogram shown on the display, and wherein the length of theline or parallelogram is proportional to the value that isrepresentative of each image variable. Then when the sum of therepresentative values is equal to a pre-defined constant (X) thesubstantially contiguously arranged display components may extend from astart point to a target end point that is indicated on the display.

Optionally, the method may further comprise the following steps:

-   -   receiving an input that changes a value that is representative        of one of the variables;    -   consequentially adjusting one or more other values that are        representative of one or more other variables so that the sum of        the values is equal to the pre-defined constant (X); and    -   for each of the values that have been adjusted, adjusting the        display component that corresponds to the adjusted image        variables.

Optionally, for any of the values that have been adjusted that arerepresentative of an image variable that is associated with an attributeof the image capture device, adjusting both the display component andattribute of the image capture device that corresponds to the adjustedvalue.

Optionally, the step of receiving an input that changes one of thevalues that is representative of one of the variables may comprisereceiving a user input that changes one of the values that isrepresentative of one of the variables, consequentially adjusting boththe corresponding display component and a corresponding attribute of animage capture device.

Optionally, the variables may comprise factors that impact on an imageluminance/brightness of an image to be captured. These factors maycomprise attributes of an image capture device and conditions thataffect scene brightness/luminance of the scene.

Optionally, variables may comprise aperture size (D_(r)), shutter speed(T_(r)), and sensitivity (S_(r)) of an image sensor of the image capturedevice, and scene luminance (L_(r)) for the scene. Optionally, thevariables may further comprise flash intensity (F) andtransmittance/optical density of any neutral density filters (ND).

Optionally, the pre-defined constant (X) may correspond to a sum of therepresentative values that results in a captured image having an averageluminance equivalent to between 10% and 20% reflectance in visiblelight, and preferably between 12.5% and 18% reflectance in visiblelight.

Optionally, the values that are representative of each of the variablesmay each positively correlate with the corresponding variable.Optionally, the values that are representative of each of the variablesmay positively correlate with the image luminance of the captured image.

Optionally, the method may further comprise receiving a user input thatinitiates the capturing of an image using one or more current imagevariables as changed by the receiving of the input.

Optionally, the step of determining values that are representative ofeach of a plurality of variables may comprise obtaining initial valuesfrom each of one or more inputs of an image capture device, wherein theinputs are obtained from one or more of user controls of the imagecapture device, external device connections, and sensors of the imagecapture device.

Optionally, the step of representing each of the image variables on adisplay using a display component may comprise any of:

-   -   for each of the variables, generating a corresponding display        component on an electronic visual display of an image capture        device; or    -   for each of the variables, providing a corresponding display        component of a mechanical display.

According to a second aspect there is provided a method of operating animage capture device to capture an image of a scene, the methodcomprising the steps of:

-   -   determining values that are representative of each of a        plurality of image variables;    -   representing each of the image variables on a display using a        display component, wherein a dimension of each display component        is proportional to the value of the corresponding image        variable, and wherein the display components representing each        of the image variables are arranged substantially contiguously        such that when the sum of the values is equal to a pre-defined        constant (X) the substantially contiguously arranged display        components extend between an origin point on the display and a        target end point on the display;    -   receiving an input that changes one of the values that is        representative of one of the image variables, consequentially        adjusting one or more other values that are representative of        other image variables so that the sum of the image variables is        equal to the pre-defined constant (X) and, for each of the        values that have been adjusted, adjusting the display component        that corresponds to the adjusted image variables;    -   capturing of an image using the current image variables.

According to a third aspect there is provided a computer readable mediumstoring computer interpretable instructions which when interpreted by aprogrammable computer cause the computer to perform a method inaccordance with any other aspect.

According to a fourth aspect there is provided a computer-implementedmethod of operating an image capture device, the method comprising thesteps of:

-   -   using a processor to determine values that are representative of        each of a plurality of image variables;    -   using a processor to represent each of the image variables on a        display using a display component, a dimension of each display        component being correlated with the value of the corresponding        image variable, and the display components representing each of        the image variables being arranged substantially contiguously        such that when the sum of the image variables is equal to a        pre-defined constant (X) the substantially contiguously arranged        display components extend between an origin point on the display        and a target end point on the display;    -   upon receiving an input that changes one of the values that is        representative of one of the image variables, using a processor        to consequentially adjust the corresponding display component;        and    -   using an image sensor of the image capture device to capture an        image using the current image variables.

According to a fifth aspect there is provided a computer-implementedmethod of operating an image capture device, the method comprising thesteps of:

-   -   using a processor to determine values that are representative of        each of a plurality of image variables;    -   using a processor to represent each of the image variables on a        display using a display component, a dimension of each display        component being correlated with the value of the corresponding        image variable, and the display components representing each of        the image variables being arranged substantially contiguously        such that when the sum of the image variables is equal to a        pre-defined constant (X) the substantially contiguously arranged        display components extend between an origin point on the display        and a target end point on the display;    -   upon receiving an input that changes one of the values that is        representative of one of the image variables, using a processor        to consequentially adjust one or more other values that are        representative of other image variables so that the sum of the        image variables is equal to the pre-defined constant (X) and,        for each of the values that have been adjusted, to adjust the        display component that corresponds to the adjusted image        variables; and using an image sensor of the image capture device        to capture an image using the current image variables.

References to “display components” may be taken to refer to one or morearcs of the circle arrangement disclosed herein. In some embodiments,these arcs will also function as input control components that a usercan touch on a touch screen.

According to a sixth aspect there is provided an image capture devicethat is arranged to capture an image of a scene. The image capturedevice comprises an image sensor, a plurality of inputs, a display, anda processor. The processor is configured to:

-   -   determine values that are representative of each of a plurality        of image variables;    -   represent each of the image variables on the display using a        display component, a dimension of each display component being        proportional to the value of the corresponding image variable,        and the display components representing each of the image        variables being arranged substantially contiguously such that        when the sum of the image variables is equal to a pre-defined        constant (X) the substantially contiguously arranged display        components extend between an origin point on the display and a        target end point on the display;    -   receive an input that changes one of the values that is        representative of one of the image variables and consequentially        adjust the corresponding display component; and cause the image        sensor to capture an image using the current image variables.

According to a seventh aspect there is provided an image capture devicethat is arranged to capture an image of a scene. The image capturedevice comprises an image sensor, a plurality of inputs, a display, anda processor. The processor is configured to:

-   -   determine values that are representative of each of a plurality        of image variables; represent each of the image variables on the        display using a display component, a dimension of each display        component being correlated with the value of the corresponding        image variable, and the display components representing each of        the image variables being arranged substantially contiguously        such that when the sum of the image variables is equal to a        pre-defined constant (X) the substantially contiguously arranged        display components extend between an origin point on the display        and a target end point on the display;    -   receive an input that changes one of the values that is        representative of one of the image variables, consequentially        adjust one or more other values that are representative of other        image variables so that the sum of the image variables is equal        to the pre-defined constant (X) and, for each of the values that        have been adjusted, to adjust the display component that        corresponds to the adjusted image variables; and cause the image        sensor to capture an image using the current image variables.

Optionally, the image sensor of the image capture device may compriseany of an electronic image sensor (e.g. a charge-coupled device (CCD)image sensor or an active-pixel sensor (APS)/CMOS image sensor) and alight-sensitive material (e.g. photographic film).

Optionally, the inputs may comprise user controls of the image capturedevice. Optionally, the user controls of the image capture device maycomprise one or more of a touch screen, a touch pad, a voice-userinterface, a gesture recognition device, a motion sensing device andmanually operated user input devices (e.g. buttons, knobs, wheels,sliders, and switches). Optionally, the inputs may further comprise oneor more of external device connections, and sensors of the image capturedevice.

Optionally, the display may comprise any of an electronic visual displayand a mechanical display.

Optionally, the image capture device may be any of a photographiccamera, a smart phone, a microscope, a video camera, a virtual camerawithin a virtual embodiment, a wearable camera, and/or a multi aperturecomputational camera.

Optionally, the image capture device may comprise a camera deviceproviding the image sensor and a peripheral control device providing thedisplay and one or more of the plurality of inputs, the peripheralcontrol device and the camera device being configured to communicatewith one another. Optionally, the processor may then be provided by anyof the camera device and the peripheral control device.

According to an eighth aspect there is provided a user control device.The user control device comprises an interface configured to communicatewith the device, a plurality of inputs, a display, and a processor. Theprocessor is configured to:

-   -   determine values that are representative of each of a plurality        of variables;    -   represent each of the variables on the display using a display        component, a dimension of each display component being        proportional to the value of the corresponding variable, and the        display components representing each of the variables being        arranged substantially contiguously such that when the sum of        the variables is equal to a pre-defined constant (X) the        substantially contiguously arranged display components extend        between an origin point on the display and a target end point on        the display;    -   receive an input that changes one of the values that is        representative of one of the variables and consequentially        adjust the corresponding display component.

Optionally, the device is an image capture device operable to capture animage of a scene. Optionally, one or more of the plurality of variablescomprise image variables, for the reasons as disclosed herein.Optionally, the user control device further comprises an image capturedevice.

According to a ninth aspect there is provided a user control device (oruser controllable device) for controlling an image capture device. Theuser control device comprises an interface configured to communicatewith the image capture device, a plurality of inputs, a display, and aprocessor.

The processor is configured to:

-   -   determine values that are representative of each of a plurality        of image variables;    -   represent each of the image variables on the display using a        display component, a dimension of each display component being        correlated with the value of the corresponding image variable,        and the display components representing each of the image        variables being arranged substantially contiguously such that        when the sum of the image variables is equal to a pre-defined        constant (X) the substantially contiguously arranged display        components extend between an origin point on the display and a        target end point on the display;    -   receive an input that changes one of the values that is        representative of one of the image variables, consequentially        adjust one or more other values that are representative of other        image variables so that the sum of the image variables is equal        to the pre-defined constant (X) and, for each of the values that        have been adjusted, to adjust the display component that        corresponds to the adjusted image variables; and cause the image        capture device to capture an image using the current image        variables.

Optionally, the interface may comprise any of a wireless transceiver anda hardware interface connection.

Optionally, the plurality of inputs may comprise user controls of theuser control device. Optionally, the user controls of the user controldevice may comprise one or more of a touch screen, a touch pad, avoice-user interface, a gesture recognition device, a motion sensingdevice and manually operated user input devices (e.g. buttons, knobs,wheels, sliders, and switches). Optionally, the inputs may furthercomprise one or more of sensors of the image capture device the outputsof which are communicated to the user control device over the interface.

According to another aspect, there is provided a method for controllinga device having one or more variables, comprising the steps of:representing one or more variables as one or more segments in a doughnutchart; wherein each segment has a start and an end point along acircumference of the doughnut chart; displaying the doughnut chart;receiving user inputs to adjust the start point and/or the end point ofat least one of the one or more segments; adjusting the one or morevariables in accordance with the adjusted start and/or end point of eachof the one or more segments; wherein each of the one or more segmentscan be adjusted to overlap a neighbouring of the one or more segments.

By providing a doughnut chart, a suggested total value for the sum ofthe variables can be represented over 360 degrees, such that segments ofthe doughnut chart can overlap neighbouring segments where the total sumof the variables exceeds this suggested total value. Where the sum ofthe variables is lower than this suggested total value, the doughnutchart can be shown with a gap between at least two of the segments. Auser can adjust each “end” of each segment to reduce or increase itssize along the circumference of the doughnut chart, causing the segmentsto overlap, open up a gap between two segments, or such that the edgesof neighbouring segments meet to reach the suggested total value. Byadjusting the segment sizes, the underlying variables of the devicerepresented by the respective segment can be altered, thus providing acontrol method for a device that provides feedback using the doughnutchart.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments will now be more particularly described by way of exampleonly with reference to the accompanying drawings, in which:

FIG. 1 illustrates schematically a conventional image capture device;

FIG. 2 is a flow diagram illustrating the method of operating an imagecapture device as described herein;

FIG. 3 is a flow diagram illustrating a preferred embodiment of themethod of operating an image capture device as described herein thatfurther comprises steps that implement a semi-automated mode of imagecapture;

FIG. 4 is a flow diagram illustrating an embodiment of the step ofrepresenting each of the image variables on a display using a displaycomponent;

FIG. 5 is a flow diagram illustrating an embodiment of the step ofconsequentially adjusting the dimension of a display component toreflect a change in the corresponding representative value;

FIGS. 6a to 6j illustrate example embodiments in which each of thedisplay components comprises a circular arc;

FIGS. 7a to 7d illustrate example embodiments in which each of displaycomponents a parallelogram;

FIG. 8 illustrates schematically an embodiment of an image capturedevice suitable for implementing the methods described herein;

FIG. 9 illustrates schematically an embodiment in which the displaycomprises an electronic visual display and touch control that isprovided as an integral component of a digital camera;

FIG. 10 illustrates schematically a further embodiment in which thedisplay comprises an electronic visual display that is provided as anintegral component of a digital camera;

FIG. 11 illustrates schematically an embodiment in which the displaycomprises a mechanical display;

FIG. 12 illustrates a method of operating a wearable image capturedevice; and

FIG. 13 illustrates a set of images using a range of different variablevalues.

DETAILED DESCRIPTION

In order to at least mitigate the problems identified above there willnow be described a method of operating devices such as an image capturedevice to capture an image of a scene. Specifically, the embodimentdescribed relates to an image capture device, wherein the scenecomprises objects that are within a field of view of the image capturedevice. The method of operating devices, with minor implementationchanges, is applicable to other types of devices and some furtherexample devices are described further below.

FIG. 2 is a flow diagram illustrating the method of operating an imagecapture device according to an embodiment. The method involvesdetermining values that are representative of each of a plurality ofimage variables (110), and representing each of the image variables on adisplay using a display component, a dimension of each display componentbeing proportional to the value that is representative of thecorresponding image variable and the display components representingeach of the image variables being arranged substantially contiguously(120). The arrangement of the display components is such that when thesum of the representative values corresponding to each of the imagevariables is equal to a pre-defined constant (X) then the displaycomponents extend between an origin point on the display and a targetend point on the display.

Then, upon receiving an input that changes one of the values that isrepresentative of one of the image variables (130), the dimension of thecorresponding display component that is proportional to the value isconsequentially adjusted (140) to reflect the change. This process ofadjusting the display components in response to a change in therepresentative value of a corresponding image variable can be repeatedup until the point at which image capture is initiated. Then, when imagecapture is subsequently initiated (160), an image is then captured usingthe current image variables (170).

In this embodiment, the value of the pre-defined constant (X)corresponds to a target image luminance/brightness. By way of example,in some embodiments the pre-defined constant (X) could be configured tocorrespond to a target image luminance that is equivalent to between 10%and 20% reflectance of visible light, and preferably between 12.5% and18% reflectance of visible light. Consequently, when the substantiallycontiguously arranged display components extend between an origin pointon the display and a target end point on the display, this illustratesthat the current image variables will result in a captured image havingthe target image luminance/brightness. It can be arranged such that thevalues that are representative of each of the image variables positivelycorrelate with the image luminance of the captured image (i.e. that anincrease in the representative value corresponds to an increase in theimage luminance, and a decrease in the representative value correspondsto a decrease in the image luminance).

Consequently, the image variables can include any factors that impact onthe image luminance/brightness of the image to be captured and willtherefore comprise the attributes of the image capture device and anyconditions that affect the scene luminance/brightness. Typically, theimage variables will therefore comprise at least the aperture size (D),shutter speed (T), and sensitivity (S) of an image sensor of the imagecapture device, and scene luminance (L_(v)) for the scene.

In this regard, the aperture size (D), shutter speed (T), andsensitivity (S) are all attributes of the image capture device such thatan input that changes any one of these image variables could be a userinput made using user controls of the image capture device. These usercontrols can be provided on the image capture device itself, or may beprovided on an external device that is in communication with the imagecapture device. For example, the user controls could be provided on aseparate computer device (e.g. smart phone, tablet computer, smart watchetc.) that communicates with the image capture device using either awired or wireless connection.

In contrast, scene luminance (L_(v)) is a condition of the environmentsurrounding the scene that cannot directly be changed using the controlsof the image capture device. Consequently, the scene luminance (L_(v))will be determined from measurements made by a light sensor. This sensorcan be provided as part of the image capture device; however, it mayalso be provided by an external light meter that communicates with theimage capture device using either a wired or wireless connection. It isappreciated that scene luminance can conventionally be indirectlycontrolled by, for example, a flash on a camera or smartphone cameraand/or by lamps on a microscope.

The image variables may also further comprise the user controlledlighting, such as flash intensity (F) of any applied flash and/or thetransmittance/optical density of any neutral-density filter (ND). Flashcan be provided by either an internal flash unit provided as part of animage capture device or by an external flash unit. Flash intensity (F)could therefore be considered to be one or both of an attribute of theimage capture device and a condition that affects the scene luminance.Similarly, neutral-density filters can be provided as either an integralpart of an image capture device or by a separate accessory that isattached to the image capture device. The transmittance/optical densityof any neutral-density filter could therefore be considered to be one orboth of an attribute of the image capture device and a condition thataffects the scene luminance.

Therefore, as shown in FIG. 2, if an input changes a representativevalue that is representative of an image variable that is associatedwith an attribute of the image capture device, then the attribute of theimage capture device that corresponds to the adjusted value is alsoconsequentially adjusted (150) so as to reflect the change in the imagevariable.

FIG. 3 is a flow diagram illustrating an embodiment of the method ofoperating an image capture device as described above that furthercomprises steps that implement a semi-automated mode of image capture.In this embodiment, the method further comprises, after receiving aninput that changes a value that is representative of one of the imagevariables (130), consequentially adjusting one or more other values thatare representative of other image variables so that the sum of thevalues is equal to the pre-defined constant (X) (135). Then, for each ofthe values that have been adjusted, the dimension of the correspondingdisplay component that is proportional to the value is consequentiallyadjusted (145) to reflect the change.

For each of the one or more other values that are consequentiallyadjusted and that are representative of an image variable associatedwith an attribute of the image capture device, then the attribute of theimage capture device that corresponds to the adjusted value is alsoconsequentially adjusted (155) so as to reflect the change in the imagevariable. Then, when image capture is subsequently initiated (160), animage is then captured using the current image variables (170).

As described above, the display components are arranged such that whenthe sum of the representative values corresponding to each of the imagevariables is equal to a pre-defined constant (X), then the displaycomponents extend between an origin point on the display and a targetend point on the display. Consequently, when the sum of therepresentative values is greater than the pre-defined constant (X) thesubstantially contiguously arranged display components will extendbeyond the target end point, and when the sum of the representativevalues is less than the pre-defined constant (X) the substantiallycontiguously arranged display components do not reach the target endpoint.

In some embodiments, the display components comprise correspondinglyshaped elements shown by the display. In some embodiments, each displaycomponent comprises a shape shown on the display for which the dimensionthat is proportional to the value that is representative of thecorresponding image variable extends between a first end to a second endof the display component. The substantially contiguous arrangement ofthe display components then requires that the first end of a displayelement corresponding to one of the image variables is adjacent to thesecond end of an immediately preceding display component.

FIG. 4 is a flow diagram illustrating an embodiment of the step ofrepresenting each of the image variables on a display using a displaycomponent (120). In this embodiment, this step of the method furthercomprises, for a first display component, positioning a first end of thedisplay component at the origin point and causing a dimension of thedisplay component to be proportional to the representative value of thecorresponding image variable (121). Then, for an immediately subsequentdisplay component, positioning a first end of the subsequent displaycomponent adjacent to a second end of the first display component andcausing a dimension of the subsequent display component to beproportional to the representative value of the corresponding imagevariable (122). This process is then repeated for all of the displaycomponents that represent the applicable image variables (123).Consequently, for the next immediately subsequent display component, afirst end of the subsequent display component is positioned adjacent toa second end of the immediately preceding display component and adimension of the subsequent display component is made to be proportionalto the representative value of the corresponding image variable (122).

FIG. 5 is a flow diagram illustrating an embodiment of the step ofconsequentially adjusting the dimension of a display component toreflect a change in the corresponding representative value (140, 145).In this embodiment, this step of the method further comprises, for thechanged image variable, adjusting a dimension of the correspondingdisplay component to be proportional to the representative value of thechanged image variable (141). Then, for an immediately subsequentdisplay component, repositioning the subsequent display component suchthat a first end is adjacent to a second end of the immediatelypreceding display component (142). This process is then repeated for allof the subsequent display components (i.e. for all of the those displaycomponents that subsequent to the display component corresponding to thechanged image variable) (143).

In some embodiments, each of the display components comprises a circulararc shown on the display, and the length of the arc is then proportionalto the value that is representative of each image variable. In such anembodiment, when the sum of the representative values is equal to thepre-defined constant (X) then the substantially contiguously arrangeddisplay components can extend around a circumference of a circle and atleast partially complete the approximate formation of the circle. Forexample, FIGS. 6a to 6j illustrate example embodiments in which each ofthe display components (311, 312, 313, 314) comprises a circular arcwherein the length (l_(a)) of each arc is proportional to the value thatis representative of the corresponding image variable. FIGS. 6a, 6e and6g illustrate examples in which the sum of the representative values isequal to the pre-defined constant (X) such that the substantiallycontiguously arranged display components extend from an origin point(315) to a target end point (316) such that they form a circle. Incontrast, FIGS. 6b, 6c, 6d, 6f, 6h, 6i, and 6j then illustrate examplesin which the sum of the representative values is less or more than thepre-defined constant (X) such that the substantially contiguouslyarranged display components extend around a circumference of a circlebut do not reach the target end point (316) or extend beyond the targetend point. One or more of the representative values may be a negativevalue, and hence a negative display component may be shown.

As described above, in FIGS. 6a to 6j the display components (311, 312,313, 314) contiguously arranged such that extend around thecircumference of a circle. To do so, a first end (311 a) of a firstdisplay component (311) is positioned at the origin point (315). Thedimension of the first display component (311) (i.e. the arc length,L_(a1)) is then configured to be proportional to the representativevalue of the corresponding image variable. A first end (312 a) of thesecond display component (312) is then positioned adjacent to a secondend (311 b) of the first display component (311). The dimension of eachdisplay component that is proportional to the representative value isthat dimension which extends between the first end of the displaycomponent and the second end of the display component. The dimension ofthe second display component (312) (i.e. the arc length, l_(a2)) is thenconfigured to be proportional to the representative value of thecorresponding image variable. This arrangement then continues for eachof the third and fourth display components (313, 314).

In the examples of FIGS. 6a and 6c , in which the sum of therepresentative values is equal to the pre-defined constant (X), thesecond end (314 b) of the fourth and final display component (314)reaches/is located at the target end point (316) such that the displaycomponents form a circle. In the examples of FIGS. 6b and 6d , in whichthe sum of the representative values is less than the pre-definedconstant (X), the second end (314 b) of the fourth and final displaycomponent (314) does not reach the target end point (316). Thecontiguously arranged display components therefore extend around aportion of the circumference of a circle.

In the examples illustrated in FIGS. 6a to 6j the value that isrepresentative of the scene luminance (L_(v)) is displayed using acircular arc (311) that is effectively offset from those arcs thatdisplay the other image variables. This offsetting is achieved byreducing the radius of arc (311) relative to the other arcs. However,this offsetting could equally be achieved by increasing the radius ofarc (311) relative to the other arcs. In either case, the arcs are stillarranged such that the second end (311 b) of the arc (311) representingthe scene luminance is adjacent to the first end (312 a) of the next arc(312) such that the path defined by the contiguously arranged displayelements is clearly a circle. This offsetting of the arc (311) thatdisplays the scene luminance representative value may be present at alltimes, or it may only occur in the event (as for example in FIG. 6c )wherein the image components sum to a value greater than the target X.This offsetting of the arc (311) that displays the scene luminancerepresentative value may in some embodiments additionally illustrate toa user of the image capture device that this is an image variable thatis not an attribute of the image capture device and is therefore not inthe direct control of the user.

In addition, it is also possible for other arcs to be offset relative toone another. For example, this may be desirable in situations in whichthe sum of the variables is greater than the pre-defined constant (X),such that the substantially contiguously arranged display componentsextend beyond the target end point. In this case, offsetting of the arcsallows the arcs to extend beyond the target end point withoutoverlapping on top of one another, and thereby clearly illustrates tothe user the extent to which the sum of the variables is greater thanthe pre-defined constant (X) (e.g. that corresponds to the target imageluminance/brightness).

In a further exemplary embodiment, each of display components comprisesany of a line and parallelogram shown on the display, and the length ofthe line or parallelogram is then proportional to the value that isrepresentative of each image variable. For example, FIGS. 7a to 7dillustrate example embodiments in which each of display components (411,412, 413, 414) comprises a rectangle wherein the length of the rectangleis proportional to the value that is representative of the correspondingimage variable. FIGS. 7a to 7d illustrate examples in which the sum ofthe representative values is equal to the pre-defined constant (X) suchthat the substantially contiguously arranged display components (411,412, 413, 414) extend from an origin point (415) to a target end point(416) along a pre-defined, linear path.

In some embodiments the target end point is explicitly indicated on thedisplay. In particular, the target end point would be explicitlyindicated on the display by a further display component. For example, inFIG. 7d the target end point (416) is explicitly indicated by a furtherdisplay component (417) comprising a triangle located adjacent to thetarget end point.

As described above, in FIGS. 7a to 7d the display components (411, 412,413, 414) extend from an origin point (415) to a target end point (416)along a pre-defined, linear path. To do so, a first end (411 a) of afirst display component (411) is positioned at the origin point (415).The dimension of the first display component (411) (i.e. the length,l_(L1)) is then configured to be proportional to the representativevalue of the corresponding image variable. A first end (412 a) of thesecond display component (412) is then positioned adjacent to a secondend (411 b) of the first display component (411). The dimension of eachdisplay component that is proportional to the representative value isthat dimension which extends between the first end of the displaycomponent and the second end of the display component. The dimension ofthe second display component (412) (i.e. the length, l_(L2)) is thenconfigured to be proportional to the representative value of thecorresponding image variable. This arrangement then continues for eachof the third and fourth display components (413, 414).

FIG. 8 illustrates schematically an embodiment of an image capturedevice (200) suitable for implementing the methods described herein. Theimage capture device (200) is typically implemented as a combination ofhardware components and software, and comprises a memory (201), aprocessor (202), a display (203), an image sensor (204), a shuttermechanism (205), an aperture mechanism (206), and a plurality of usercontrols (207). Optionally, the image capture device (200) may furthercomprise a light meter (208) and/or a wireless transceiver (209) and/ora hardware interface connection (210). In addition, the image capturedevice (200) could also be provided with means for providing audioand/or haptic feedback to the user.

The memory (201) typically stores the various programs/executable filesthat are implemented by the processor (202), as well as any other datathat may be of use to the device (200). In particular, the memory (201)will store the value of the pre-defined constant (X).

The processor (202) is configured to implement the processing necessaryto perform the methods described above in accordance with computerinterpretable instructions that are stored in the memory (201) in theform of one of programs/executable files. In particular, the processor(202) is configured to perform the steps of:

-   -   i. determining values that are representative of each of a        plurality of image variables,    -   ii. representing each of the image variables on the display        using a display component, a dimension of each display component        being proportional to the value of the corresponding image        variable, and the display components representing each of the        image variables being arranged substantially contiguously such        that when the sum of the image variables is equal to a        pre-defined constant (X) the substantially contiguously arranged        display components extend between an origin point on the display        and a target end point on the display,    -   iii. upon receiving an input that changes one of the values that        is representative of one of the image variables, consequentially        adjusting the corresponding display component; and    -   iv. causing the image sensor to capture an image using the        current image variables.

In addition, the processor (202) may be configured to implement asemi-automated mode of image capture as described above. In particular,the processor (202) would then be further configured to perform thesteps of:

-   -   iii. after receiving an input that changes a value that is        representative of one of the image variables, consequentially        adjusting one or more other values that are representative of        other image variables so that the sum of the values is equal to        the pre-defined constant (X); and    -   iv. for each of the values that have been adjusted,        consequentially adjusting the dimension of the corresponding        display component that is proportional to the value to reflect        the change; and    -   v. causing the image sensor to capture an image using the        current image variables.

The display (203) is configured to display the substantiallycontiguously arranged display components and could comprise any of anelectronic visual display and a mechanical display.

By way of example, FIGS. 9 and 10 illustrate schematically embodimentsin which the display comprises an electronic visual display that isprovided as an integral component of a digital camera. In particular, inthe embodiment of FIG. 9 the display is provided by a screen provided inthe rear surface of a digital camera. In the embodiment of FIG. 10 thedisplay is provided by a separate electronic visual display located onan upper surface of a digital camera, adjacent to control wheels thatprovide user controls for each of the aperture size (D), shutter speed(T), and sensitivity (S). In addition, or as an alternative to theembodiments shown in FIGS. 9 and 10, the display could be provided by aviewfinder of an image capture device.

As an alternative example, FIG. 11 illustrates schematically anembodiment in which the display comprises a mechanical display. Inparticular, in the embodiment of Figure lithe display is provided in theform of a wheel chart or volvelle. This exemplary wheel chart displaycomprises a partial wheel for each image variable with the wheels beingcentrally aligned and successively stacked, and with the wheels beingrotatable relative to one another around a common axis. Therepresentative values used for a variable are provided around theperimeter of the corresponding partial wheel such that the portion ofeach partial wheel that is not covered by an overlapping portion ofanother partial wheel can display the currently selected values of eachimage variable. As a further example, a similar mechanical display couldbe provided by a linear slide chart in which the display would comprisea linear strip for each of the image variables, with the strips beinglongitudinally aligned and partially overlapping, and with the stripsbeing capable of longitudinal movement relative to one another. FIG. 13further exemplifies the embodiment of FIG. 11 in a digital setting.

The image sensor (204) of the image capture device (200) is configuredto detect the light that constitutes the image to be captured. Forexample, the image sensor (204) could comprise any of an electronicimage sensor (e.g. a charge-coupled device (CCD) image sensor or anactive-pixel sensor (APS)/CMOS image sensor) and a light-sensitivematerial (e.g. photographic film).

The shutter mechanism (205) is configured to control the length of timethat light can enter the image capture device (200) and reach the imagesensor (204). The shutter mechanism (205) could therefore comprise aconventional shutter mechanism as found in conventional image capturedevices. For example, the shutter mechanism (205) could comprise one ormore opaque curtains or leaves disposed in front of the image sensor(204) that block light from reaching the image sensor (204), and one ormore actuators that move the curtains or leaves so as to expose theimage sensor (204) once image capture has been initiated. Alternatively,an electronic image sensor can be constructed to emulate the function ofa mechanical shutter mechanism.

The aperture mechanism (206) is configured to regulate the amount oflight that passes through the lens of the image capture device andcontrols the depth of field. The aperture mechanism (206) couldtherefore comprise a conventional aperture mechanism as found inconventional image capture devices. For example, the aperture mechanism(206) could comprise an optical diaphragm that defines an aperture ofvariable diameter.

The user controls (207) are arranged to allow a user to control theattributes of the image capture device, to initiate the capture of animage, and to generally allow the user to interact with the imagecapture device. The user controls (207) could therefore comprise one ormore of a touch screen, a touch pad, a voice-user interface, a gesturerecognition device, a motion sensing device and manually operated userinput devices (e.g. buttons, knobs, wheels, sliders, and switches). Theuse of such a gesture recognition device is shown in FIG. 12.

In some embodiments, the user controls (207) comprise a touch screenthat allows the user to control/change the values representing each ofthe aperture size (D), shutter speed (T), and sensitivity (S) of theimage capture device. In such embodiments it would be preferable thetouch screen provide the functionalities of both the user controls (207)and the display (203) such that the user can control the attributes ofthe image capture device by touching the corresponding display elementsdisplayed on the touch screen.

In another embodiment, the user controls (207) comprise three rotatableknobs/wheels, each of which can be used to control/change the valuesrepresenting one of the aperture size (D), shutter speed (T), andsensitivity (S) of the image capture device. For example, in theembodiment illustrated in FIG. 10, three rotatable knobs/wheels arelocated adjacent to a hand grip located at one end of the image capturedevice (200) and are arranged so that each of these knobs/wheels can beeasily operated by the thumb or forefinger of a user who is holding theimage capture device (200) with the grip located in the palm of theirhand. This embodiment provides that a user can easily control/adjust thevalues of each of the aperture size (D), shutter speed (T), andsensitivity (S) of the image capture device whilst holding the imagecapture device with either one or both hands.

If present, the light meter (208) is configured to determine a value forthe scene luminance (L_(v)) by measuring the light reflected by thescene. The light meter (208) could therefore comprise a conventionallight meter as found in conventional image capture devices. For example,the light meter (208) could comprise a photodetector that provides anoutput that is proportional to the average luminance of the detectedlight as a measure of the scene luminance.

If present, the transceiver (209) would be configured to transmit andreceive information wirelessly. The transceiver (209) could therefore beused to communicate with external/peripheral control devices (211)and/or external/peripheral sensor devices (212). For example, thetransceiver (209) could be used to communicate with a computer device(e.g. smart phone, tablet computer, smart watch, smart glasses etc.)that provides a peripheral display and/or set of user controls for theimage capture device (200). In addition, or alternatively, thetransceiver (209) could be used to communicate with a peripheral lightmeter.

If present, the hardware interface connection (210) would be configuredto transmit and receive over a wired connection. The hardware interfaceconnection (210) could therefore be used to communicate withexternal/peripheral control devices (211) and/or external/peripheralsensor devices (212). For example, the hardware interface connection(210) could take the form of a Universal Serial Bus (USB) or otherstandard connector that allows the external/peripheral control devices(211) and/or external/peripheral sensor devices (212) to be connectedvia a cable. The hardware interface connection (210) could then be usedto communicate with a computer device (e.g. smart phone, tabletcomputer, smart watch etc.) that provides a peripheral display and/orset of user controls for the image capture device (200). In addition, oralternatively, the hardware interface connection (210) could be used tocommunicate with a peripheral light meter.

DETAILED EXAMPLES

As described above, the image variables all affect either the amount oflight reaching the image sensor or the sensitivity of the image sensor.Consequently, the image variables will all affect theluminance/brightness of the image to be captured. The above describedmethods therefore recognise that by selecting an appropriate definitionfor the values that represent each of the image variables it is possibleto define a relationship between these representative values in whichtheir sum will be equal to a constant that corresponds to a particularimage luminance/brightness. In particular, by making use ofrepresentative values that each positively correlate with thecorresponding image variable, and therefore also positively correlatewith the image luminance of the captured image, the sum of theserepresentative values will be representative of the image luminance ofthe captured image and can therefore be compared with a pre-definedconstant (X) that corresponds to a target image luminance/brightness.These values and their relationship to the image luminance/brightnesscan then be used to implement the methods of image capture describedabove to provide both improved control and improved feedback for theuser of an image capture device.

This relationship between the image variables and the pre-definedconstant (X) that corresponds to a target image luminance/brightness cantherefore be expressed as:

L _(r) +A _(r) +S _(r) +T _(r) =X  Formula 1

where L_(r) is the value that is representative of the scene luminance(L_(v)), A_(r) is the value that is representative of the aperture size(D), S_(r) is the value that is representative of the sensitivity (S),and T_(r) is the value that is representative of the shutterspeed/exposure time (T).

The following provides exemplary formulae for deriving representativevalues for each of the image variables and a corresponding value for thepre-defined constant (X) that corresponds to a target imageluminance/brightness that is associated with an exposure that istypically considered to be correct.

In this specific example, L_(r) is derived from the metered sceneluminance (L_(v)) given in candelas/m² by the following formula:

L _(r)=8+log₂(L _(v)/0.3K)  Formula 2

where K is the reflected light metering constant, usually taken to be12.5 by most camera manufacturers.

A_(r) is derived from the diameter (D) of the aperture given inmillimetres (mm) by the following formula:

A _(r)=9-2 log₂(f/D)  Formula 3

where f is the focal length of the lens.

S_(r) is derived from the corresponding ISO rating for sensitivity (S)of the image sensor by the following formula:

S _(r)=log₂(ISO/3.125)−5  Formula 4a

(alternatively described as S_(r)=log₂(S/3.125)−5 Formula 4b)

T_(r) is derived from the exposure time (t) in seconds by the followingformula:

T _(r)=12+log₂(t)  Formula 5

When using representative values derived using these formulae a suitablevalue for the pre-defined constant (X) is 24. In this example, the value24 corresponds to a sum of the representative values that results in acaptured image having an average luminance equivalent to approximately12% reflectance in visible light, which is often associated with anexposure that is typically considered to be correct. However, a valuefor the pre-defined constant (X) that corresponds to a sum of therepresentative values that results in a captured image having an averageluminance equivalent of between 10% and 20% could be considered acorrect exposure, although it is preferable that the value correspondsto between 12% and 18% reflectance in visible light. In this regard, 18%has conventionally been taught as corresponding to a ‘correct exposure’,whilst most manufacturers use a value of 12 or 12.5%.

It is then straightforward to provide the above described display anddisplay components to display these representative values and thepre-defined constant (X) of 24. In particular, in an embodiment theserepresentative values are each displayed using display elements in theform of a circular arc where the length of the arc is then proportionalto the corresponding representative value, as illustrated in FIGS. 6a to6d . When the sum of the representative values is equal to thepre-defined constant (X) of 24 then the substantially contiguouslyarranged display components extend around a circumference of a circle,as illustrated in FIGS. 6a and 6 c.

In an embodiment, the display is provided as a touch screen so that theuser can interact directly with each of the display elements. Thisprovides the user with a simple and intuitive way to control theattributes of the image capture device whilst constantly receivingfeedback as to the affect that changing these attributes will have onthe image to be captured. In addition, this also provides astraightforward and intuitive process for implementing a semi-automatedmode in which a change in one of these variable attributes by the userresults in an automatic, consequential change in one of the otherattributes. Specifically, when using a touch screen, a semi-automatedcontrol mode could be implemented by configuring the controls such thatwhen the user touches and swipes one end of a display elementcorresponding to an attribute of the image capture device, this willchange size (i.e. increase or decrease, depending upon the direction ofthe swipe) of the display element touched by the user (and thecorresponding representative value and attribute of the device) and alsothe size of the display element that is adjacent to the end touched bythe user (and the corresponding representative value and attribute ofthe device).

Consequently, this allows the user to make use of semi-automated modesimply by touching one end of a display element and provides that thissemi-automated mode of control allows the user to effectively selectwhich of the other attributes should be automatically andconsequentially adjusted by choosing which end of the display element totouch. For example, in an embodiment in which the representative valuesare each displayed using display elements in the form of a circular arc,where the length of the arc is then proportional to the correspondingrepresentative value, a user could touch the display element related tothe time variable at a location proximate to the end that meets thedisplay element related to the aperture variable and swipe to adjust thetime variable. The image capture device could be configured such thatthis action implicitly indicates that user wishes to make use of shutterpriority mode, in which the aperture is automatically adjusted so as toensure that the sum of the representative values is equal to thepre-defined constant (X).

The device could then be configured to implement a full manual mode whenthe user touches and swipes a display element away from either of itstwo ends. In this case, only the display element touched by the userwill change in size (i.e. increase or decrease, depending upon thedirection of the swipe).

It is also envisaged that this straightforward method of implementingsemi-automated mode could be provided using a mechanical controls. Byway of example, the image capture device could be provided with threedials/wheels for controlling the image variables relating to the cameraattributes, one for each of the. aperture size (D), sensitivity (S), andexposure time (T)). Implementing a preferred semi-automated mode couldthen be achieved by configuring one or more of the dials/wheels to alsoact as a button wherein a single press of the dial/wheel selects acorresponding semi-automated mode. The dial/wheel can then be used toset the representative value for the corresponding image variable. Forexample, pressing the aperture wheel would select aperture prioritymode, whilst pressing the exposure time wheel would select shutterpriority mode. Alternatively, each of the dials/wheels could be providedby two dials/wheels stacked one above the other, where rotating the topdial selects a first semi-automated mode, rotating the bottom dialselects a second semi-automated mode, and rotating both dials togetherselects manual mode.

It will be appreciated that individual items described above may be usedon their own or in combination with other items shown in the drawings ordescribed in the description and that items mentioned in the samepassage as each other or the same drawing as each other need not be usedin combination with each other. In addition, the expression “means” maybe replaced by actuator or system or device as may be desirable. Inaddition, any reference to “comprising” or “consisting” is not intendedto be limiting in any way whatsoever and the reader should interpret thedescription and claims accordingly.

Furthermore, although the invention has been described in terms ofembodiments as set forth above, it should be understood that theseembodiments are illustrative only. Those skilled in the art will be ableto make modifications and alternatives in view of the disclosure whichare contemplated as falling within the scope of the appended claims. Inparticular, whilst the above described examples have been described inrelation to their use in image capture devices, the skilled person willrecognise that various features of the above described embodiments willbe equally applicable to other, including non-imaging, devices, such asimage processing devices, image viewing devices, standalone light metersand exposure calculators, and in wearables and augmented realitydevices, or in any device comprising one or more variables to becontrolled in conjunction with each other.

For example, the above described methods could be implemented by imageprocessing devices during post-processing of images in order to provideuser control and feedback when editing images. As a further example, theabove described methods could be implemented by standalone light metersand exposure calculators in order to provide user control and feedbackwhen using such devices to determine the attributes of an image capturedevice that should be used to capture an image. As a yet furtherexample, aspects of the above described methods could be implemented byimage viewing devices when displaying images such that the images areaccompanied by the above described display elements thereby illustratingthe image variables used to the capture the image.

Moreover, whilst the above described examples have been described inrelation to their use in conventional image capture devices, it isequally applicable to image capture devices that make use of‘computational imaging’ techniques in combination with multiplecamera/lens modules. In this regard, computational imaging is anapproach that allows the benefits of a conventional, relatively largeelectronic image sensor to be achieved through a combination of manysmall electronic image sensors whose individual low-information imagesmay be computationally combined to form a large-information image. Forexample, a 3×3 array of small electronic image sensors (12 mm×9 mm) hasthe same combined area and therefore a similar amount of light andinformation can be gathered as from a single full frame sensor (36 mm×24mm). However, the array of relatively small electronic image sensors canbe arranged to be much flatter and occupy a much smaller volume thanthat of a full frame sensor. Images captured using computational imagingcan have synthetic grain blur (which positively correlates with thesensitivity of the image sensor), motion blur (which positivelycorrelates with the exposure time), and background blur (whichpositively correlates with the aperture size) applied in order torecreate the effects achievable with conventional image capture devices.The above described methods could therefore be implemented when applyingsynthetic exposure effects to images captured using computationalimaging.

In addition, these methods could be adapted to provide further benefitsin such circumstances. For example, as synthetic exposure effects do notneed to have a corresponding increased effect on imageluminance/brightness, each of the synthetic exposure effects could berepresented on a display using their own display elements, which areseparate/distinct from those display elements representing the imagevariables of the captured image. Increasing or decreasing any of thesesynthetic exposure effects would then be configured to cause apositively correlated increase or decrease in a dimension of thecorresponding, distinct display elements. However, the distinct displayelements representing each of the synthetic exposure effects could beoffset relative to the display elements representing the image variablesof the captured image, thereby illustrating that changes in thesynthetic exposure effects do not affect the image luminance/brightness.

Although some of the embodiments described above with reference to thedrawings comprise computer apparatus and processes performed in computerapparatus, it is envisaged that the methods and apparatus described meanthat any aspects extend to computer programs, particularly computerprograms on or in a carrier, adapted for putting the invention intopractice. The program may be in the form of source or object code or inany other form suitable for use in the implementation of theprocesses/apparatus of any aspect. The carrier could be any entity ordevice capable of carrying the program.

For example, the carrier may comprise a storage medium, such as a ROM,for example a CD ROM or a semiconductor ROM, or a magnetic recordingmedium, for example a floppy disc or hard disk. Further, the carrier maybe a transmissible carrier such as an electrical or optical signal whichmay be conveyed via electrical or optical cable or by radio or othermeans.

When a program is embodied in a signal which may be conveyed directly bya cable or other device or means, the carrier may be constituted by suchcable or other device or means.

Alternatively, the carrier may be an integrated circuit in which theprogram is embedded, the integrated circuit being adapted forperforming, or for use in the performance of, the relevant processes.

It is understood that image variables can comprise positive or negativevalues. For example, in the case of imaging devices, each of the imagevariables used for exposure can occupy a range from infinitely positivevalues to infinitely negative values.

When an image variable changes to a negative value, the displaycomponent correspondingly is displayed as a negative value. Hence itstarts at the end of the preceding value, but rather than continuingpositively and contiguously, the display component travels negativelyalong the same dimension. This negative travel may be represented as abackwards movement of the display when compared with the direction oftravel for a positive value. Display components may, as in the case ofnegative values, be offset and hence follow the path of a differentradius around the same circle, so as to ensure that the contiguouslyarranged values do not obscure one another.

When an image variable changes to zero value the display component maybe arranged correspondingly to shrink to a zero value and hencedisappear. However it is advantageous to provide a way to indicate to auser where the image variable display component is, even if it is at azero value. The user may wish to control the variable to change it to anon-zero value in the future.

Further, in the context of an imaging device, different exposurevariables may all contribute to a final image brightness. These exposurevariables can include: scene luminance, aperture size, time, andsensitivity. In addition to these image variables, image brightness canbe increased with computational imaging techniques such as throughcombining, or “stacking” multiple images of the same scene. For example,two images will double the image brightness, and 16 images will doubleimage brightness 4 times. This may be represented as 1*2⁴.

Although it will be appreciated that a range of variable values may beused, a table of exemplary values is presented below:

Luminance Sensitivity Aperture Time cd/m² Lr ISO Sr f/ Ar sec Tr 0.004−2 25 −2 45 −2  1/16000 −2 0.008 −1 50 −1 32 −1 1/8000 −1 0.016 0 100 022 0 1/4000 0 0.031 1 200 1 16 1 1/2000 1 0.063 2

2 11 2 1/1000 2 0.125 3 800 3

1/500  3 0.25 4 1600 4 5.6 4 1/250  4 0.5 5 3200 5 4 5 1/125  5 1 6 64006 2.8 6 1/60   6 2 7 12800 7 2 7

  

4 8 25600 8 1.4 8 1/15   8 8 9 51200 9 1 9 1/8    9 16 10 102400 101/4    10 32 11 204800 11 1/2    11

409600 12 1 12 128 13 819200 13 2 13 256 14 1638400 14 4 14 512 15 8 151024 16 15 16 2048 17 30 17 4096 18 60 18 8192 19

The results of using the highlighted values above may be shown in FIG.13.

Each variable in the abovementioned Formula 1 ofL_(r)+A_(r)+S_(r)+T_(r)=X may be defined by its own equation thatconverts each value from traditional metrics. This may include adifferent numbering system for exposure and a new scale for each of itsconstituent metrics (L_(r), A_(r), S_(r), T_(r), and X). For each metrica rate of change and a baseline or zero value is defined.

It is desirable that a common standard be established for these metricsand the numbering system as a whole.

While the scale of each metric may be set arbitrarily, there arenumerous consequences or constraints for each of the design choices ofscaling of each metric and the interaction between these. Accommodatingthese constraints can lead to a numbering system and to a set of scaledmetrics that are no longer arbitrary. There is a limited latitude tochange the scale and baseline of the metrics, but the tabulated valuesabove represent a balance based on the constraints.

It is an objective of the arrangement disclosed herein to provide theability for users to:

-   -   quickly build familiarity with the values of each variable and        the technical effect that each represents;    -   make rapid visual assessments of the current value of each image        variable;    -   make rapid visual assessment of the brightness of the final        image relative to the target image brightness, thereby        determining whether the final image is too dark, too bright, or        correctly exposed; and/or    -   mentally compute interactions between the image variables and        the pre-defined constant (X), thus aiding planning settings to        be made.

In one embodiment, the pre-defined constant (X) may be defined as 24.This is a value sufficiently large to accommodate a wide range of sceneluminances and variables of S_(r), A_(r), and T_(r), while alsoremaining small enough for a typical user to perform mental arithmeticto sum the image variable values to arrive at an image brightness value.

In embodiments having a substantially circular interface, such as adoughnut chart, target total values of either 12 or 24 are desirableowing to:

-   -   familiarity of today's population with a 12 or 24 unit        configuration on a circular display device (i.e. clocks);    -   the value 24 being highly divisible, i.e. by any of the integers        1, 2, 3, 4, 6, or 8;    -   The ease of a user being able to visually judge the position and        size of image variables relative to the cardinal points of the        compass (the 6, 12, 18, and 24 position); and    -   The use of exponents with a common base of 2.

Each image variable is expressed as the exponent value to a common base,and in this embodiment a base of 2. This allows for an elegant equationof X=L_(r)+S_(r)+A_(r)+T_(r), as disclosed above. For the majority ofconventionally used values, the image variables are positive values. Inthe circular embodiment this may achieve a clear feedback and controlinterface of a circle whose constituent display components all progress,with each one positively following the next. The user may also besupported through the use of relatively straightforward mentalarithmetic of image variables, and the clear visual judgment in relationto the size and position of image variables.

In the example case where all the variable values are positive, they donot double back on themselves and therefore provide an unclutteredcontrol interface that is easy to touch the desired display elementwithout accidentally touching a parallel display element. If a valuegoes negative it indicates to the user that this is unusual and isoutside the normal range.

The image sensors on many conventional modern cameras have a basesensitivity of between ISO 50 and ISO 200. ISO 100 occupies a particularrole in setting the baseline for measuring exposure value EV (which inthis example is set to EV100). When S has a zero value (“S0”), it mayseem to disappear, or at least remain unobtrusive, in the userinterface, thereby reducing the number of image variables on display andallowing additional focus by the user on the remaining values. This maybe instrumental in keeping the user interface (“UI”) as uncluttered aspossible. In this example, S0 is set between ISO 25 and ISO 400.

In the abovementioned example, Time T0= 1/4,000 seconds (“sec”). 1/8,000sec to 1/2,000 sec is considered an approximate range of commerciallyavailable mechanical shutter speeds on cameras today. Electronic shutterspeeds can be appreciably faster.

Setting S0 at 1/4,000 in combination with X=24 leads to a sequence ofvalues where natural inflections measured in time that relate totravelling quarter arcs around the UI circle. Points may be providedthat are easy for a user to remember, for example: 1/4,000=0 (emptycircle), 1/60 sec=6 (quarter circle), 1 sec=12 (half circle), 1 min=18(three quarters circle), or 60 min=24 (full circle). An exemplary valueto set T0 is between 1/1,000 sec and 1/64,000 sec.

In the abovementioned example, the Aperture A0=f22. The range of valueson variable aperture cameras is conventionally able to be set from f2 tof16, with more specialist lenses operable to expand that range from f1to 45. This range is defined by the physical constraints of optics laws.Diffraction is considered aesthetically unacceptable for very high fnumbers and lenses become impractically heavy and expensive at valuesbelow f1. An exemplary value to set A0 is between f45 and f16.

Setting luminance L0=0.016 cd/m² is equivalent to that of a sceneilluminated by a full moon. A majority of images are taken in lightingconditions within a range equivalent to naturally lit conditions of afull moon through to full sun on snow. This is approximately a 19-stoprange of luminance (19 doublings). Photographs are conventionally takenmore frequently in lighting conditions within this range than in scenesthat are either dimmer or brighter than the range. Setting a zerobaseline for the luminance scale as equivalent to 16 cd/m² can providesufficient space on the circular interface arrangement to accommodatepositive luminance values up to the brightest natural conditions (forexample, full sun on snow) and leave space for one or more of theremaining image variables to have non-zero, positive values. Anexemplary value of L0 is between 0.016 cd/m² and 0.004 cd/m².

Image stacking may be performed using different methods. Images can betaken from the same imagining device separated over time, or images canbe taken from an array of different cameras at the same time, or acombination of the two. Each method results in different imageaberration, also referred to as “blur”.

It has been known to provide a positive user experience in practice togive a user something recognisable as a “touchable” item. Touch tabs mayconventionally be used as icons at the end of each display component forthe user to touch. Where touch tabs are used, their size may contributeto the size of the display component as it extends along the dimensionin which display components are contiguously arranged.

An imaging device, such as a camera, can be linked to a head mounteddisplay that provides visual feedback to the user. This display may beused in combination with abovementioned gesture controls wherein theuser sees a virtual version of the control interface and is able tocontrol it using one or more gestures.

It will further be appreciated that the abovementioned use of thedisclosed method is for example purposes only, and a generic form of anymethod, apparatus, system, or kit of parts disclosed herein may be used.

When technology is used by people, there is conventionally a userinterface challenge. A user interface solution is therefore provided fora subset of these user interface challenges. The solution disclosedherein may be used in relation to technologies that have multiple inputvariables that combine to achieve an overall effect. This may bereferred to as the “total primary effect”. The individual variables mayeach also have a secondary effect. Such technologies may include inputvariables which either sum or a multiply to impact the total primaryeffect.

In one embodiment, for example imaging, there are input variablescomprising: light, aperture, time, and sensitivity. All of thesecontribute to the total primary effect of image brightness. Thesevariables also each have secondary effects of; background blur, motionblur, grain blur. The input variables multiply one upon the other toachieve final image brightness.

Each input variable can be expressed using exponentiation, comprising abase and an exponent. By using a common base across all the inputvariables, each variable's exponent may be used to represent its value.

Because all variables use a common base, the total primary effect can becalculated by summing the exponents of each input variables. In theimaging example a base of 2 is used. That is the increments betweenaperture sizes are doublings, and likewise the increments between timevalues are doublings (e.g. 1/1000 sec, 1/500 sec, 1/250 sec, etc). Thusan example of multiplying four variables could look as follows:

2¹²*2³*2³*2⁶=2²⁴

This may be simplified to:

12+3+3+6=24

This formula can then be embodied in a display and control device. Thusan information and control feedback loop is provided. The display ofinformation reflects the underlying physics of the device or systembeing controlled. It provides the user with a model from which tounderstand and fluently control what are otherwise a complex set ofinterdependent variables. It provides an intuitive control interfacethat matches the physics and/or design of the information system. The“circle” of variables generated in the case of imaging can be consideredas a visualisation of the formula governing final image brightness.

Technological systems such as these allow for multiple, even infinite,arrangements of input variables that all deliver the same total primaryeffect. To further illustrate with imaging, an infinite variation ofsettings for light, aperture, time, and sensitivity can be combined todeliver the same total primary effect of image brightness. However thesecondary effects of the input variable will be very different. Thus theuser has a complex optimisation problem to solve.

Therefore there is generated a complex set of conditions. Withoutsuitable feedback it is difficult to intuit: a level of each variable(relative to some baseline); a relationship of each of the inputvariables on the total primary effect; or the relationship of each inputvariable to each other.

Further examples are also provided. A common theme in the examples belowis that the “circle” display is used to give an energy reading. Any ofbrightness, audio volume, and thermal comfort may be considered asenergy related.

In the use case for a violin, the volume of a violin can be increased byfour methods; bow speed, bow pressure, proximity of bow to the bridge,and angle of bow. While all four variables contribute to volume (thetotal primary effect) they also have their own very different effects onthe quality of the sound:

-   -   Faster bowing increases volume and makes a ‘harsher’ sound;    -   Pressure of the bow on the strings increases volume and creates        a ‘fuller’ sound;    -   Playing with the bow close to the bridge increases volume and        creates a ‘broader’ sound; and    -   The angle of the bow determines how many strings are played.        More strings increase volume and add more notes that are being        played.

Each of these variables can be recorded in real time, for examplethrough a smartphone or computer tablet application, and may bedisplayed as a circular display arrangement on a screen as disclosedherein. The practicing violinist could then receive visual feedback toreinforce what they feel and hear that they are doing. The variablescould be measured through sensors on the instrument that give relativeposition and angle of the bow to the violin or a microphone and computerlistening for the effect of these.

In relation to other audio-related uses, there are many ways tomanipulate audio data. One subset of controls comprises: volume andvolume of specific frequency bands (bass, mid, and treble tones). Theserelate to frequency bands of low, mid and high frequency. Volume, alsoreferred to as loudness, may be considered a measure of sound pressurewhich in turn is a summation of the energy level of all frequencies ofsound. Increasing any one of the frequency bands, base, mid, or treble,will increase the volume of that band and will increase the totalprimary effect of overall volume.

In the use case for thermal comfort, the method disclosed herein may beused as a component of a control interface for thermal comfort in asmart home. Input variables that contribute to the total primary effectof thermal comfort may include from the environment: air temperature,air speed, radiant heat, relative humidity and they further include fromthe person; metabolic rate, clothing, personal calibration/response,skin dryness/sweating, speed of person through air, and psychologicalfactors.

In the case of a smart house where heating, air conditioning, humidity,blinds/radiation, and ventilation air speed are controlled, thehouseholders may be equipped with a wearable device, such as a smartwatch or glasses that detect the user's metabolic rate, clothing worn,skin dryness, and movement. Empirical readouts of one or more of theinputs contributing to thermal comfort can be calculated. The user maybe presented with a display/input device that illustrates a summary ofthese inputs and gives the user control over the smart-house controls ina convenient way. For example, there may be a target power consumptiondesired or other capacity or “budget” for desired output—this is used toset the total value X—and then the variables that contribute to this canbe set out as the portions of the interactive display component, forexample the doughnut chart sections, which can then be modified by auser to set the power settings for some smart-house systems—e.g.air-conditioning, battery charging—but some variables may be fixed anddetermined by actual current consumption—e.g. current power draw foressential systems such as refrigeration.

By using a circular waterfall chart that is both a user feedback andcontrol device, control may be afforded over a plurality of inputvariables as well as over the total primary effect. By using a circularembodiment, a clear end point is provided when the path reaches all theway back round to the origin. By way of comparison, a linear display ofinformation conventionally requires markers to indicate the end andpossibly the beginning of a sequence. Further, the human mind oftenfinds it more manageable to judge the comparative length of a circulararc than the length of straight line segments. It may be understood at aglance the proportions approximating to ¼, ½, ¾, and a full circle andare able to judge values in between these, as well as detecting if acircle is incomplete or complete.

Any system feature as described herein may also be provided as a methodfeature, and vice versa. As used herein, means plus function featuresmay be expressed alternatively in terms of their correspondingstructure.

Any feature in one aspect may be applied to other aspects, in anyappropriate combination. In particular, method aspects may be applied tosystem aspects, and vice versa. Furthermore, any, some and/or allfeatures in one aspect can be applied to any, some and/or all featuresin any other aspect, in any appropriate combination.

It should also be appreciated that particular combinations of thevarious features described and defined in any aspects can be implementedand/or supplied and/or used independently.

1. A feedback and control method of operating a device, the devicehaving a visual display, the method comprising: determining values thatare representative of each of a plurality of variables; representingeach of the variables on the display using a display component, whereina dimension of each display component is proportional to the value thatis representative of the corresponding variable, and wherein the displaycomponents representing each of the variables are arranged substantiallycontiguously such that when the sum of the values is equal to apre-defined constant (X) the substantially contiguously arranged displaycomponents extend between an origin point on the display and a targetend point on the display wherein each display component comprises ashape shown on the display for which the dimension that is proportionalto the value that is representative of the corresponding variableextends between a first end and a second end of the display component,and wherein the display components are arranged such that the first endof a display component corresponding to one of the variables is adjacentto the second end of an immediately preceding display component; andreceiving an input that changes a value that is representative of one ofthe variables and consequentially adjusting both the correspondingdisplay component and a corresponding attribute of the device. 2.-5.(canceled)
 6. The method of claim 1, wherein the target end point isindicated on the display by a further display component.
 7. (canceled)8. The method of claim 1, wherein the display components comprisecorrespondingly shaped elements shown by the display.
 9. (canceled) 10.The method of claim 1, wherein each of the display components comprisesa circular arc shown on the display, and wherein the length of the arcis proportional to the value that is representative of each variable.11. The method of claim 10, wherein when the sum of the representativevalues is equal to the pre-defined constant (X) the substantiallycontiguously arranged display components extend around a circumferenceof a circle.
 12. The method of claim 1, wherein each of the displaycomponents comprises any of a line or a parallelogram shown on thedisplay, and wherein the length of the line or parallelogram isproportional to the value that is representative of each variable. 13.(canceled)
 14. The method of claim 1, and further comprising:consequentially adjusting one or more other values that arerepresentative of one or more other variables so that the sum of thevalues is equal to the pre-defined constant (X); and for each of thevalues that have been adjusted, adjusting the display component thatcorresponds to the adjusted variables.
 15. The method according to claim1, wherein, for any of the values that have been adjusted that arerepresentative of a variable that is associated with an attribute of thedevice, adjusting both the display component and attribute of the devicethat corresponds to the adjusted value. 16.-21. (canceled)
 22. Themethod of claim 1, wherein the values that are representative of each ofthe variables each positively correlate with the corresponding variable.23.-24. (canceled)
 25. The method of claim 1, wherein the step ofdetermining values that are representative of each of a plurality ofvariables comprises: obtaining initial values from each of one or moreinputs of the device, wherein the inputs are obtained from one or moreof user controls of the device, external device connections, or sensorsof the device.
 26. The method of claim 1, wherein the step ofrepresenting each of the variables on a display using a displaycomponent comprises any of: for each of the variables, generating acorresponding display component on an electronic visual display of thedevice; or for each of the variables, providing a corresponding displaycomponent of a mechanical display.
 27. A non-transitory computerreadable medium storing computer interpretable instructions which wheninterpreted by a programmable computer cause the computer to perform amethod in accordance with claim
 1. 28. An device comprising: a sensor; aplurality of inputs; a display; and a processor; wherein the processoris configured to: determine values that are representative of each of aplurality of variables; represent each of the variables on the displayusing a display component, a dimension of each display component beingproportional to the value of the corresponding variable, and the displaycomponents representing each of the variables being arrangedsubstantially contiguously such that when the sum of the variables isequal to a pre-defined constant (X) the substantially contiguouslyarranged display components extend between an origin point on thedisplay and a target end point on the display, wherein each displaycomponent comprises a shape shown on the display for which the dimensionthat is proportional to the value that is representative of thecorresponding variable extends between a first end and a second end ofthe display component, and wherein the display components are arrangedsuch that the first end of a display component corresponding to one ofthe variables is adjacent to the second end of an immediately precedingdisplay component; and receive an input that changes a value that isrepresentative of one of the variables and consequentially adjust boththe corresponding display component and a corresponding attribute of thedevice.
 29. The device of claim 28, wherein the processor is configuredto: consequentially adjust one or more other values that arerepresentative of one or more other variables so that the sum of thevariables values is equal to the pre-defined constant (X) and, for eachof the values that have been adjusted, to adjust the display componentthat corresponds to the adjusted variables.
 30. The device of claim 28,wherein the inputs comprise user controls of the device.
 31. The deviceof claim 30, wherein the user controls of the device comprise one ormore of a touch screen, a touch pad, a voice-user interface, a gesturerecognition device, a motion sensing device or manually operated userinput devices.
 32. The device of claim 30, wherein the inputs furthercomprise one or more of external device connections, or sensors of thedevice.
 33. The device of claim 28, wherein the display comprises any ofan electronic visual display or a mechanical display. 34.-41. (canceled)